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What is claimed is : 

1. A monitoring apparatus for diagnosing faults in a system, comprising: 
a reference data store containing failure mode identification data and 

5 associated system data indicative of behavior of said system in the failure mode; 
and 

a similarity engine responsive to monitored system data indicative of 
monitored behavior of said system, for generating at least one similarity value for a 
comparison of the monitored data to said failure mode associated system data, as a 
10 diagnostic indication of said failure mode. 

2. An apparatus according to claim 1, wherein said system data is residual 

data. 

15 3. An apparatus according to claim 2, further comprising: 

a model for generating estimates of operational data in response to 

receiving operational data from said system; and 

a signal generator for differencing the estimates and the received 

operational data to generate the residual data. 

20 

4. An apparatus according to claim 3, wherein said model for generating 
estimates is a non-parametric model. 

5. An apparatus according to claim 1, further comprising a failure 

25 identification module responsive to similarity values from the similarity engine for 
determining an indicated failure mode. 

6. An apparatus according to claim 5, wherein said failure identification 
module compares similarity values for a plurality of failure modes in said data 

30 store, and identifies at least the failure mode with the highest similarity as an 
indicated failure mode of said system. 
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7. An apparatus according to claim 5, wherein said failure identification 
module compares similarity values for a plurality of failure modes in said data 
store, and identifies at least the failure mode with the highest average similarity as 

5 an indicated failure mode of said system. 

8. An apparatus according to claim 5, wherein said failure identification 
module compares similarity values for a plurality of failure modes in said data 
store, and identifies as an indicated failure mode of said system at least the failure 

10 mode with at least a selected number of highest similarities over a window of 
successive comparisons. 

9. An apparatus according to claim 5, wherein said failure identification 
module compares similarity values for a plurality of failure modes in said data 

15 store, and identifies as an indicated failure mode of said system at least the failure 
mode with at least a selected number of highest average similarities over a window 
of successive comparisons. 

10. A method for diagnosing faults in a monitored system, comprising the 
20 steps of: 

acquiring monitored system data indicative of monitored behavior of said 
system; and 

comparing for similarity the monitored system data to reference system 
data associated with a failure mode to generate a similarity value as a diagnostic 
25 indication of said failure mode. 

11. A method according to claim 10, wherein said system data is residual 

data. 

30 12. A method according to claim 11, further comprising the steps of: 
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generating estimates of operational data in response to acquiring 
operational data from said system; and 

differencing the estimates and the received operational data to generate the 
residual data. 

5 

13. A method according to claim 10, further comprising the step of 
determining an indicated failure mode based on similarity values resulting from 
the similarity comparisons. 

10 14. A method according to claim 13, wherein said deterrmning step 

comprises comparing the similarity values for a plurality of failure modes, and 
identifying at least the failure mode with the highest similarity as an indicated 
failure mode of said system. 

15 15. A method according to claim 13, wherein said determining step 

comprises comparing the similarity values for a plurality of failure modes, and 
identifying at least the failure mode with the highest average similarity as an 
indicated failure mode of said system. 

20 16. A method according to claim 13, wherein said determining step 

comprises comparing the similarity values for a plurality of failure modes, and 
identifying as an indicated failure mode of said system at least the failure mode 
with at least a selected number of highest similarities over a window of successive 
comparisons. 

25 

17. A method according to claim 13, wherein said determining step 
comprises comparing the similarity values for a plurality of failure modes, and 
identifying as an indicated failure mode of said system at least the failure mode 
with at least a selected number of highest average similarities over a window of 
30 successive comparisons. 
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18. A monitoring apparatus for diagnosing faults in a system, comprising: 

a kernel-based non-parametric model responsive to monitored parameter 
data from said system for generating estimates of the monitored parameter data; 

an alert module disposed to produce parameter alerts in response to a 
5 comparison of said estimates to said monitored data; and 

a failure identification module for identifying an impending failure mode in 
said system by matching said parameter alerts with at least one reference alert 
pattern associated with said failure mode. 

10 19. An apparatus according to claim 18, wherein said alert module performs 

a sequential probability ratio test on at least one parameter. 

20. An apparatus according to claim 18, wherein said alert module produces 
an alert when the difference of an estimate and corresponding monitored data 

15 exceeds a selected threshold. 

21. An apparatus according to claim 18, wherein said kernel-based non- 
parametric model employs a Nadaraya-Watson kernel regression. 

20 22. An apparatus according to claim 18, wherein said kernel-based non- 

parametric model is a similarity-based model. 

23. A method for diagnosing faults in a monitored system, comprising the 
steps of: 

25 comparing for similarity monitored parameter data from said system to 

reference parameter data characteristic of known behavior of said system; 

generating estimates of the monitored parameter data based on the 
similarity comparison; 

generating alerts in response to a comparison of said estimates to said 
30 monitored data; and 
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identifying an impending failure mode in said system by matching said 
parameter alerts with at least one reference alert pattern associated with said failure 
mode. 

5 24. A method according to claim 23, wherein said alert generating step 

comprises performing a sequential probability ratio test on at least one parameter. 

25. A method according to claim 23, wherein said alert generating step 
comprises producing an alert when the difference of an estimate and corresponding 

10 monitored data exceeds a selected threshold. 

26. A monitoring apparatus for diagnosing faults in a system, comprising: 
a similarity engine responsive to monitored parameter data from said 

system for generating estimates of the monitored parameter data; 
15 means for differencing the estimates and the monitored data to generate 

residual data; and 

means for recognizing an impending failure mode by comparing for 
similarity said residual data to reference residual data associated with the failure 
mode. 

20 

27. An apparatus according to claim 26, further comprising means for 
communicating remedial control commands to a control program for said system. 

28. An apparatus according to claim 26, further comprising a control 
25 module for operating said system, responsive to recognition of an impending 

failure of said system from said recognizing means for remedially controlling said 
system. 

29. An apparatus according to claim 26, further comprising a profile data 
30 store for storing and providing reference parameter data characteristic of known 

behavior of said system, to said similarity engine for generation of the estimates. 
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30. An apparatus according to claim 26, further comprising a failure mode 
data store for storing said reference residual data and associated failure mode 
identification data. 

5 

31. An apparatus according to claim 30 wherein said failure mode data store 
also stores information about remedial steps specific to a failure mode. 

32. A method for diagnosing faults in a monitored system, comprising the 
10 steps of: 

comparing for similarity monitored parameter data from said system to 
reference parameter data characteristic of known behavior of said system; 

generating estimates of the monitored parameter data based on the 
similarity comparison; 
15 differencing the estimates and the monitored data to generate residual data; 

and 

comparing for similarity the residual data to reference residual data 
associated with a failure mode, as a diagnostic indication of said failure mode. 

20 33. A method according to claim 32, further comprising the step of 

communicating a remedial control command to a control program for said system. 

34. A method according to claim 32, further comprising the steps of: 
recognizing an impending failure mode based on the residual similarity 

25 comparison step; and 

controlling remedially said system responsive to recognition of an 
impending failure of said system. 

35. A computer program product for diagnosing faults in a monitored 
30 system, comprising: 
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a residual testing program module for generating alerts in response to 
residual signals characterizing behavior of said system; and 

a fault pattern detection program module disposed to receive said alerts and 
indicate a fault diagnosis in said system upon matching the alerts to a reference 
5 pattern associated with said fault. 

36. A program product according to claim 35, wherein the residual testing 
program module performs a sequential probability ratio test on said residuals. 

10 37. A program product according to claim 35, wherein the residual testing 

program module compares a residual to a threshold to generate an alert when the 
residual exceeds the threshold. 

38. A program product according to claim 35, further comprising a kernel- 
15 based non-parametric model program module disposed to generate estimates of 

parameter signals from said system, and difference the parameter signals and the 
estimates to generate the residual signals. 

39. A program product according to claim 38, wherein said kernel-based 
20 non-parametric model program module employs a similarity-based model to 

generate said estimates. 

40. A program product according to claim 39 wherein said similarity-based 
model uses elemental similarities. 

25 

41. A program product according to claim 39 wherein said similarity-based 
model is a radial basis function network. 

42. A program product according to claim 38 wherein said kernel-based 
30 non-parametric model program module employs a kernel regression model to 

generate said estimates. 
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43. A method for forming a diagnostic monitoring system for a machine, 
comprising the steps of: 

instrumenting a plurality of like machines with sensors; 
5 operating said plurality of machines and collecting operational sensor data 

characterizing operation; 

autopsying each of said plurality of machines upon failure to determine a 
failure mode, and storing the failure modes for use in the diagnostic monitoring 
system; 

10 selecting a failure precursor portion of said operational sensor data collected 

for a selected interval prior to failure of each machine; and 

distilling each said failure precursor data portion into at least one failure 
signature data set and associating each set with a corresponding failure mode. 

15 44. A method according to claim 43 wherein said distilling step comprises 

selecting time-correlated snapshots of operational sensor data. 

45. A method according to claim 43 wherein said distilling step comprises 
generating time-correlated snapshots of estimated sensor data corresponding to at 

20 least a selected failure precursor data portion, differencing the estimates with the 
selected failure precursor data to form residual snapshots, and selecting at least one 
residual snapshot to be associated with the failure mode. 

46. A method according to claim 45 wherein the estimated sensor data is 
25 generated by an empirical model based on the collected operational sensor data. 

47. A diagnostic monitoring apparatus for a sensor-instrumented system 
selected from a process and a machine, comprising: 

an operational model module for modeling said system and generating 
30 estimates for said sensors in response to receiving actual values of said sensors; 
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a differencing module for generating residual signals from said estimates 
and said actual values; 

a reference library for storing failure modes and associated residual data 
values; and 

5 a failure mode recognition engine disposed to compare generated residual 

signals with said residual data values to select and output a recognized failure 
mode for said system. 



48. A diagnostic monitoring apparatus according to Claim 47, wherein said 
10 failure mode recognition engine comprises a similarity operation module for 

generating a similarity score for a comparison of said generated residual signals 
with said residual data values in said reference library. 



49. A diagnostic monitoring apparatus according to Claim 48, wherein said 
15 failure mode recognition engine further comprises a failure mode decision module 
responsive to the similarity scores generated by the similarity operation module to 
select at least one failure mode to output. 



50. A diagnostic monitoring apparatus for a sensor-instrumented system 
20 selected from a process and a machine, comprising: 

an operational model module for modeling said system and generating 
estimates for said sensors in response to receiving actual values of said sensors; 

a differencing module for generating residual signals from said estimates 
and said actual values; 
25 a testing module disposed to receive said residual signals and generate 

alerts in response thereto; 

a reference library for storing failure modes and associated alert signatures; 

and 

a failure mode recognition engine disposed to compare generated alerts 
30 with said alert signatures to select and output a recognized failure mode for said 
system. 
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51. A diagnostic monitoring apparatus for a sensor- instrumented system 
selected from a process and a machine, comprising: 

sensor input for receiving current sensor data from said system in operation; 
5 an information processor for collecting the current sensor data from the 

sensor input at selected time snapshots associated with the signals at the sensor 
input being indicative of identified states of the monitored process; 

a reference library for storing failure modes and associated snapshots of 
sensor data from said system; 
10 a failure mode recognition engine disposed to compare current sensor data 

with said snapshots to select and output a recognized failure mode for said system. 

52. A diagnostic monitoring apparatus according to Claim 51, wherein said 
failure mode recognition engine comprises a similarity operation module for 
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snapshot of sensor data stored in said reference library. 



53. A diagnostic monitoring apparatus according to Claim 52, wherein said 
failure mode recognition engine further comprises a failure mode decision module 
20 responsive to the similarity scores generated by the similarity operation module to 
select at least one failure mode to output. 



54. A diagnostic monitoring apparatus according to Claim 53, wherein said 
failure decision module selects the at least one failure mode based on a highest 

25 similarity score for any one snapshot in said reference library. 

55. A diagnostic monitoring apparatus according to Claim 53, wherein said 
failure decision module selects the at least one failure mode based on a highest 
average similarity score across sets of snapshots associated with each failure mode 

30 in said reference library. 
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56. A diagnostic monitoring apparatus for a sensor-instrumented system 
selected from a process and a machine, comprising: 

a sensor input receiver for receiving current sensor data from conveyed 
signals acquired at selected time snapshots as inputs indicative of said system in 
5 operation; 

a memory for storing empirical model estimates of parameter values in 
response to collected signals indicative of the monitored process corresponding to a 
universe of identified states of the monitored process; 

a reference library for storing failure modes and associated snapshots of 
10 sensor data from said system; 

an information processor for collecting the conveyed signals acquired at 
selected time snapshots as inputs indicative of identified states of the monitored 
process; 

a similarity operator implemented within said information processor 
15 operable on the acquired time snapshots and the parameter values from said 
memory for generating an expected state vector responsive to said similarity 
operator; and 

a failure mode recognition engine disposed to compare current sensor data 
with said snapshots to select and output a recognized failure mode for said system. 

20 

57. A diagnostic monitoring apparatus according to claim 50, wherein said 
similarity operator comprises a training matrix utilizing the empirical model 
estimates of the parameter values from said memory to determine similarity as a 
function of an absolute magnitude in response to the observed states of the 

25 monitored process. 

58. A diagnostic monitoring apparatus according to claim 50, wherein said 
similarity operator comprises: 

a model for generating estimates of signals representative of the monitored 
30 process in response to the actual acquired signals from the data acquisition device 
operable at the process monitoring site; and 
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a similarity engine for generating a similarity score for a comparison of a set 
of signals from said model and a related set of acquired signals from said data 
acquisition device. 

5 59. A diagnostic monitoring apparatus according to claim 52, wherein said 

similarity engine generates the similarity score within a bounded scaler range, with 
the absolute value of the similarity increasing with generated estimates and the 
acquired signals approaching identical values. 

10 60. A diagnostic monitoring apparatus according to claim 52, wherein said 

similarity engine comprises kernel regression empirical modeling to generate an 
estimate based on a current observation. 

61. A diagnostic monitoring apparatus according to claim 54, wherein the 
15 kernel regression comprises a Gaussian kernel. 

62. A diagnostic monitoring apparatus according to claim 50, wherein said 
failure mode recognition engine comprises a similarity operation module for 
generating a similarity score for a comparison of said current sensor data with a 

20 snapshot of sensor data stored in said reference library. 

63. A diagnostic monitoring apparatus according to claim 56, wherein said 
failure mode recognition engine further comprises a failure mode decision module 
responsive to the similarity scores generated by the similarity operation module to 

25 select at least one failure mode to output. 

64. A diagnostic monitoring apparatus according to claim 57, wherein said 
failure decision module selects the at least one failure mode based on a highest 
similarity score for any one snapshot in said reference library. 

30 
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65. A diagnostic monitoring apparatus according to claim 57, wherein said 
failure decision module selects the at least one failure model based on a highest 
average similarity score across sets of snapshots associated with each failure mode 
in said reference library. 
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